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ABSTRACT 

We investigate the improvements in Shack-Hartmann wavefront sensor image pro¬ 
cessing that can be realised using total variation minimisation techniques to remove 
noise from these images. We perform Monte-Carlo simulation to demonstrate that at 
certain signal-to-noise levels, sensitivity improvements of up to one astronomical mag¬ 
nitude can be realised. We also present on-sky measurements taken with the CANARY 
adaptive optics system that demonstrate an improvement in performance when this 
technique is employed, and show that this algorithm can be implemented in a real-time 
control system. We conclude that total variation minimisation can lead to improve¬ 
ments in sensitivity of up to one astronomical magnitude when used with adaptive 
optics systems. 

Key words: Instrumentation: adaptive optics, instrumentation: detectors. Methods: 
numerical. Methods: statistical. 


1 INTRODUCTION 

Astronomical imaging on large telescopes is restricted in 
achievable resolution by atmospheric turbulence which per¬ 
turbs the wavefront of incident light. A solution to t his prob¬ 
lem is the use of adaptive optics (AO) systems (|Babcockl 
I 1953 I ) which use one or more wavefront sensors to measure 
these perturbations, and a deformable mirror (DM) to ac¬ 
tively compensate them in real-time. The most commonly 
used wavefront se nsor for astro nomical systems is a Shack- 
Hartmann sensor (|Shack|[l97lh which divides the telescope 
pupil plane into an array of sub-apertures and is then used 
to measure the incident instantaneous wavefront tilt across 
these. 

The isoplanatic patch of the atmosphere limits the AO 
corrected distance from the guide star on which the wave- 
front sensor is focused to about 10 arcseconds, i.e. regions 
further from the guide star are essentially uncorrected by 
the adaptive optics. Additionally, since the wavefront sen¬ 
sors require enough light to reliably detect target motion 
on millisecond timescales within each sub-aperture, bright 
targets are required. Therefore, the fraction of the sky that 
is observable with AO correction, the sky-coverage, is typ¬ 
ically only a few percent for most AO systems. Improving 
sky-coverage for AO systems is therefore desirable, requiring 
increased sensitivity wavefront sensors. 

Total variation minimisation (TVM) (|Rudin et al.l 
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I1992I) is a process that attempts to reduce the total vari¬ 
ance within a signal. Typically, a signal containing signif¬ 
icant noise will have a high total variation, and the inte¬ 
grated absolute gradient will be large. Minimisation of the 
total variation of this signal, subject to the constraint that 
the cleaned signal remains a close match to the original, re¬ 
moves unwanted noise, while retaining important features 
such as sudden gradient changes. TVM is very effective at 
removing noise in flat image regions whilst also maintaining 
image features. Alternative approaches such as median filter¬ 
ing and smoothing also reduce the noise, but unfortunately 
remove features such as sharp edges which may be inherent 
to the image, and therefore are not appropriate where high 
image fidelity is necessary. 

Fig. [Ua) shows a noiseless Shack-Hartmann wavefront 
sensor image. Within this image, there are many sharp 
peaks, the position of which (relative to some reference po¬ 
sition) requires determination with high precision, so that 
the corresponding incident wavefront can be reconstructed. 
Once noise is added (Fig.[T]Jb)), this determination becomes 
more difficult with increased uncertainty. By applying the 
principle of TVM (Fig. [D^c)), noise levels can be reduced, 
resulting in improved spot position determination. 

In §2 we provide details of the TVM algorithm that we 
have investigated, and of the investigations that we have 
performed. In §3 we present our results, including on-sky 
measurements, and we conclude in §4. 
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Figure 1. (a) An example simulated noiseless Shack-Hartmann 
wavefront sensor image, (b) with photon and readout noise added, 
(c) after noise removal using TVM. 


2 TOTAL VARIATION MINIMISATION 
MODEL AND APPLICATION DETAILS 

We u se a convergent algorithm developed by IChamboll^ 
(|2004l l for the minimisation of total variation of an image. 
This algorithm has applications beyond image noise removal, 
for example image scaling; here however we concentrate only 
on noise removal. 

It is assumed that an observed image, g is the addition 
of an a priori piecewise smooth (or with little oscillation) 
image, u and a random Gaussian noise of estimated vari- 
ance . Therefor e the original image is estimated by solving 
(|Chambollell2004l l 

min (||i^ - g\\^ = (1) 

where is the number of pixels. 

Throughout this paper, we consider noise reduction ap¬ 
plied to individual sub-apertures, rather than noise reduc¬ 
tion applied to the whole wavefront sensor image, because 
this is of most relevance to an on-sky situation: within an 
AO real-time control system, system latency is reduced (and 
hence performance improved) if individual wavefront sensor 
sub-apertures are processed separately, as soon as the rel¬ 
evant pixel data arrive at the real-time computer, rather 
than waiting and processing a whole frame at once. The 
ability to access the camera pixel stream depends somewhat 
on camera mode; h owever with the CANARY AO system 
(jMvers et al.l l2008l ) and many others, camera customisa¬ 
tion, interface development, and custom software has made 
this possible. CANARY uses the Durha m AO real-time con¬ 
troller (PARC) for wa vefront control (jBasden et al.l l2010l : 
iBasden Mverjl2012l l which is optimised for low latency 
operation, and has the ability to process sub-apertures in¬ 
dividually once pixels become available. We have therefore 
implemented the TVM algorithm within this system (which 
we discuss in applying TVM on a per-sub-aperture 

basis. 


2.1 Monte-Carlo simulation of total variation 
minimisation performance 

There are many parameters that need to be considered when 
investigating sub-aperture slope estimation improvement, 
including the size of the spots (determined by optics and 
atmospheric conditions), the signal level of the target, de¬ 
tector readout noise, and the number of pixels within each 
sub-aperture. 

We investigate performance of the noise removal algo¬ 
rithm spanning this parameter space using Monte-Carlo sim¬ 
ulation techniques. Our procedure is as follows: 


(i) A sub-aperture spot is generated at a random, known, 
position (^true)- 

(ii) Noise (photon and readout) is added. 

(iii) Spot position is estimated using a centre of gravity 
algorithm {Ssys)- 

(iv) TVM is applied to the image. 

(v) Spot position is estimated using a centre of gravity 
algorithm (S'tvm)- 

(vi) Steps 1-5 are repeated many (V) times. 

(vii) The performance metric is calculated. 

The performance metric is given by 

P Z)m=i I (*^true(^) “ S{m)) \ 

- N - 

where N is the number of measurements taken and S(m) 
is the rri^^ individual slope measurement measured with the 
Monte-Carlo realisation, either the true position, or the 
estimated position (with noise added, iSsys, and after ap¬ 
plication of noise removal, AS^vm)- essence, the absolute 
offset between estimated and true positions are computed, 
and the mean offset calculated over ten thousand realisa¬ 
tions. We refer to R as the slope error, or slope estimation 
accuracy, and to Ssys as the “No tvm” case. 

We consider signal levels from high light level, down 
to very low (10 photons per sub-aperture i.e. too low for 
good AO correction, but still of academic interest). We con¬ 
sider a range of detector readout noise from 0.1 to 16 elec¬ 
trons, which includes the parameter space for the electron 
multiplying CCDs (EMCCDs) and scientihc CMOS (sC- 
MOS) detectors that are candidate wavefront sensors, and 
also that corresponding to an electronically shuttered laser 
guide star wavefront sensor that was used with CANARY. 
Sub-aperture sizes are considered from 8 x 8 to 16 x 16 pix¬ 
els, corresponding to the sizes used for CANARY, and also 
those that are likely for wide-held Extremely Large Tele¬ 
scope (ELT)-scale AO instruments. Spot sizes are investi¬ 
gated ranging from Nyquist sampled, to spots with a EWHM 
of about four pixels, i.e. towards the practical upper size 
limit with which a typical AO system would work. 

In conjunction with the noise removal algorithm under 
consideration here, we use a ba ckground subtractio n algo¬ 
rithm based on brightest pixels (| Basden et aLllioi^ L which 
sets the image background threshold level (both noisy and 
denoised) at a level such that a given number of image pix¬ 
els remain above this threshold in each sub-aperture. When 
investigating performance, we use the number of retained 
image pixels that gives best performance. 

2.2 On-sky testing of total variation minimisation 

We have implemented the TVM algorithm within the DARC 
system that is used by CANARY. This is a dynamically 
loadable modular control system, and so the introduction of 
new algorithms does not require a modihcation of the core 
system, and these algorithms can be loaded and unloaded 
from the real-time system without affecting its subsequent 
operation, making it ideal for algorithm development. 

Our implementation includes three adjustable parame¬ 
ters, which can be altered on a sub-aperture basis (allowing 
optimised operation with wavefront sensors where the spot 
point spread function (PSE) varies across the sensor, for 
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Figure 2. A comparison showing a noisy Shack-Hartmann spot, 
and the same image after application of the TVM algorithm. 

example differing elongation when using laser guide stars). 
These are the “strength” (estimated noise standard devia¬ 
tion) of the noise removal, the tolerance level (at which the 
image is considered denoised), and the maximum number of 
iterations allowed (to avoid significant increase to AO sys¬ 
tem latency). The maximum number of iterations is set to a 
number greater than that typically required for convergence 
(in which case, the algorithm does not perform all itera¬ 
tions); it serves to prevent real-time system jitter in rare 
cases where the algorithm is not converging quickly. 

During these tests, we operate CANARY in a single con¬ 
jugate AO (SCAO) mode, using a single on-axis wavefront 
sensor, and interleave processing with and without TVM 
while measuring performance. Strehl ratio of the AO cor¬ 
rected image is our performanc e metric, computed o n-axis 
using standard CANARY tools ([Cendron et aklBoilh . 


3 DISCUSSION OF PERFORMANCE 
IMPROVEMENTS USING TVM 

Accuracy of Shack-Hartmann slope estimation has been 
investigated in simulation, comparing noisy and denoised 
Shack-Hartmann spots. Fig. shows a comparison of a sim¬ 
ulated noisy and denoised Shack-Hartmann spot. In this fig¬ 
ure, it is clearly evident that the TVM algorithm is effective 
at reducing the noise within this image. 

3.1 Performance as a function of spot size 

The size of a Shack-Hartmann spot determines, for a given 
flux level, the intensity level of the brightest pixels, since in¬ 
cident flux is spread over the spot. Fig.[3]shows performance 
as a function of signal level for different spot sizes, processed 
both with and without TVM. Here, a 16 x 16 sub-aperture 
has been used, with 0.1 electron readout noise. From this 
figure, it is evident that smaller spot sizes benefit most from 
TVM, since the difference between the noisy and denoised 
cases is largest. When using TVM, a reduction in signal level 
by a factor of between 2-3 is possible while still maintaining 
the non-TVM performance level, i.e. guide star magnitude 
can be decreased by up to one astronomical order of magni¬ 
tude when using TVM. 

3.2 Performance as a function of sub-aperture size 

For a given spot size, a larger sub-aperture will contain a 
larger number of pixels with just noise (i.e. negligible useful 
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Figure 3. A figure showing Shack-Hartmann slope estimation 
error as a function of signal level for cases with different Shack- 
Hartmann spot sizes, given as a function of Nyquist sampled size 
in the legend. Solid lines show performance with TVM, while 
dashed lines are without. Uncertainties are at the 1% level and 
are not shown for clarity. 



Figure 4. A figure showing Shack-Hartmann slope estimation er¬ 
ror as a function of signal level for different sized sub-apertures, 
with the linear dimension given in the legend. Solid lines show 
performance with TVM, while dashed lines are without. Uncer¬ 
tainties are at the 1% level and are not shown for clarity. 


signal). However, in some cases, a large sub-aperture may 
be necessary, for example in open-loop AO systems, where 
a wide-field of view is required to detect large spot motions. 
Fig. g] shows slope estimation error as a function of signal 
level, for different sub-aperture sizes. Here it is interesting 
to note that in the denoised case (with TVM), performance 
is essentially unrelated to sub-aperture size, since the TVM 
is successfully removing the background noise. However, in 
the noisy cases, performance gets worse as sub-aperture size 
increases as expected due to the presence of an increased 
number of noisy pixels. In this figure, readout noise is set 
at 0.1 electrons, and the Shack-Hartmann spot is Nyquist 
sampled. 
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Figure 5. A figure showing Shack-Hartmann slope estimation 
error as a function of signal level for cases with different readout 
noise (as given in the legend). Solid lines show performance with 
TVM, while dashed lines are without. Uncertainties are at the 
1% level and are not shown for clarity. 


3.3 Performance at low signal-to-noise ratios 

Fig. [5] shows performance as a function of signal level for 
different wavefront sensor readout noise, for a 16 x 16 pixel 
sub-aperture with a Nyquist sampled spot. Here it can be 
seen that as signal level is reduced, the slope error {R) in 
cases without TVM increases faster than with. At certain 
signal levels, using TVM allows operation at light levels a 
factor of 2-3 times lower than without TVM, whilst achiev¬ 
ing the same slope estimation accuracy. For example, with 
a readout noise of 0.1 electrons, a signal level of 30 pho¬ 
tons with TVM gives the same performance as 80 photons 
without TVM. 


3.4 Discussion of background level selection using 
brightest pixels 

So far, we have been using the number of pixels for back¬ 
ground selection that give best performance, both for the 
noisy and denoised cases. However, it is useful to investigate 
how this background affects performance. Fig.[6]shows slope 
error {R) as a function of number of brightest pixels retained 
for two different signal levels (assuming 0.1 electrons readout 
noise, a 16 x 16 sub-aperture and a Nyquist sampled spot). 
It is evident here that when there are fewer photons, TVM 
is effective at removing the effect of noise, so that the final 
slope error {R) is less dependent on the number of brightest 
pixels retained. Fig.[3shows slope error {R) as a function of 
number of brightest pixels retained for different spot sizes. 
Here, it is clear that again, TVM removes some of the sen¬ 
sitivity to background level, since noise has effectively been 
removed (a signal level of 50 photons is assumed). Similarly, 
using the above assumptions. Fig. [8] shows slope error {R) 
at different detector readout noise levels, again displaying 
the improvements brought by the TVM algorithm. 

When selecting the number of brightest pixels to retain 
during background level thresholding, the main considera¬ 
tion should be given to the size of the sub-aperture PSF. 



°'°10 20 30 40 50 60 70 80 90 100 
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Figure 6. A figure showing slope error as a function of number of 
brightest pixels retained after background level removal prior to 
slope estimation. Results for two different light levels are shown, 
with and without TVM, as noted in the legend. Uncertainties are 
at the 1% level and are not shown for clarity. 



Figure 7. A figure showing slope error as a function of number 
of brightest pixels retained after background level removal prior 
to slope estimation. Results for different sub-aperture PSF spot 
sizes are shown, with and without TVM, as noted in the legend, 
where the size is the PSF oversampling factor beyond Nyquist 
sampled. Uncertainties are at the 1% level and are not shown for 
clarity. 

Using TVM provides a key benefit of reducing the depen¬ 
dency on accurate background subtraction. 

3.5 Application to laser guide star elongated spots 

We have also investigated the application of TVM to elon¬ 
gated Shack-Hartmann spots. For the results presented here, 
we assume a spot that is elongated by a factor of three, i.e. 
three times longer in one dimension than the other. Fig. [9] 
shows performance (slope error, R) as a function of signal 
level, for different readout noise values, both with and with¬ 
out TVM. It can be seen here that the benefit obtained from 
TVM increases with readout noise, and performance is never 
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Figure 8. A figure showing slope error as a function of number 
of brightest pixels retained after background level removal prior 
to slope estimation. Results for different readout noise levels (in 
electrons) are shown, with and without TVM, as noted in the 
legend. Uncertainties are at the 1% level and are not shown for 
clarity. 
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Figure 9. A figure showing predicted Shack-Hartmann slope er¬ 
ror as a function of signal level for a 16 X 16 pixel sub-aperture 
with an elongated spot PSF (3x longer than wide). Cases with 
and without TVM are given in the legend, for different detector 
readout noise. Uncertainties are at the 1% level and are not shown 
for clarity. 


worse than without TVM. The performance improvements 
are less marked than for the natural guide star case, though 
the use of TVM can enable the same slope prediction per¬ 
formance for light levels reduced by up to about 25% for the 
high readout noise case with greater than three electrons. 


3.6 On-sky measurements 

Because on-sky time was limited, we did not attempt to 
explore a large parameter space of seeing conditions, spot 
size, signal level and readout noise. Rather, we have selected 
a target where noise is evident within the sub-apertures 
(Fig. fTOl) . and operated the CANARY AO system in SCAO 



Figure 10. (a) A single frame of a wavefront sensor image ob¬ 
tained on-sky by the CANARY AO system at the William Her- 
schel Telescope, (b) The noise removed using TVM with a vari¬ 
ance of 1 (in active sub-apertures), (c) Calibrated image after 
TVM and background subtraction. 


mode both with and without TVM. The data presented here 
were taken on the night of 12th July 2014 with CANARY 
on the William Herschel Telescope, for just over one hour 
from about Sam. 

We have taken four sets of observations, during which 
the CANARY SCAO loop was closed, and H-band science 
images obtained. Each set of observations commenced with 
a measurement without TVM, and then a number of mea¬ 
surements (8 or 20) with different TVM strength (estimated 
noise standard deviation) factors (increasing monotonically 
from 0 to 2). Within the observation set, this was then re¬ 
peated. The detector used was an EMCCD, and multiplica¬ 
tion gain was set to maximum for the first two observation 
sets, and 75% for the last two, allowing the signal level to be 
reduced. Signal level was between 500-1000 detector counts. 

Results are shown in Eig. 1111 and provide evidence that 
this technique is able to improve AO system performance, 
though, due to the lack of on-sky time, this is not wholly 
conclusive. Mean Strehl ratios for each observation set are 
shown in table [U and in each case show an improvement 
when using TVM. There is a large variation in performance 
as a function of time, which is typical of the time-varying 
seeing conditions commonly seen with CANARY. It should 
be noted that the improvement obtained using TVM is, in 
this case, small: it is likely that larger improvements would 
be seen at other signal-to-noise regimes, though this was not 
investigated on-sky. 

Because of the natural variability of seeing, we also 
show, in Eig. [TTJb), the H-band Strehl ratio as a function 
of Eried’s parameter, ro. In this case, ro is computed from 
reconstructed pseudo-open-loop slope measurements, which 
are, in turn computed from a time-series of the on-axis 
closed-loop wavefront slope measurements and the recorded 
DM actuator commands. The line fitted through these data 
points is the best-fit to the cases with TVM implemented 
(with a regression correlation 0.38). There is evidence here 
that the TVM performance is above the level of performance 
without TVM (represented by circles), indicating that the 
use of TVM has improved performance. However, again, 
there is some uncertainty, due to the lack of on-sky mea¬ 
surements, and so this should not be taken as conclusive: 
the statistical significance is low. 

There is some evidence from Eig. Efc) that using esti¬ 
mated noise standard deviation of around 0.8 in the TVM 
gives best performance (though we acknowledge that this 
could just be an artefact of the changing seeing conditions). 
Therefore, table [T] also includes the mean Strehl ratios ob¬ 
tained by considering only noise standard deviation esti- 
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Figure 11. (a) A figure showing H-band Strehl ratio obtained 
with CANARY operating in SCAO mode, both with and without 
TVM as a function of time from first observation. The red circles 
show Strehl obtained without TVM, while other points are with 
TVM at different strengths, (b) H-band Strehl ratio as a func¬ 
tion of ro, with red circles representing measurements without 
TVM, and black crosses representing measurements with TVM. 
(c) H-band Strehl ratio as a function of TVM noise standard devi¬ 
ation estimate. The horizontal lines show Strehl obtained without 
TVM. 


Table 1. AO system performance as given by H-band 
Strehl ratio (%) for CANARY operating in SCAO 
mode, both without and with TVM (with results av¬ 
eraged over all strengths, or estimated noise standard 
deviation, investigated) during the four different obser¬ 
vations made (Obs). Also shown is performance using 
TVM with strength restricted to between 0.6-1.1. 


Obs 

No TVM 

TVM 

TVM strength 0.6-1.1 

1 

18.4 ±0.1 

18.8 ± 1.8 

20.0 ± 1.6 

2 

20.3 ±1.2 

20.5 ± 1.3 

21.4 ±2.0 

3 

20.9 ±1.5 

21.4 ± 1.1 

22.0 ±0.4 

4 

19.6 ±1.6 

20.0 ± 1.8 

20.6 ±1.2 



Figure 12. A figure showing Shack-Hartmann slope error as a 
function of signal level for a 16 x 16 pixel sub-aperture and a 
detector with 16 electrons readout noise. Lines for different PSF 
sizes are shown (given in the legend), with the numbers corre¬ 
sponding to the over-sampling factor (beyond Nyquist). Cases 
with and without TVM are given in the legend. Uncertainties are 
at the 1% level and are not shown for clarity. 


mates (TVM strength) of between 0.6 to 1.1, and shows 
that indeed, using TVM in this regime leads to a further 
increase in AO performance. 


3.7 High noise wavefront sensor cameras 

The wavefront sensors commonly used for laboratory AO 
systems typically have higher readout noise than those used 
on-sky, primarily for reasons of cost. We therefore investigate 
the performance of TVM for a sensor with a readout noise 
of 16 electrons, corresponding to the Imperx Bobcat model 
that we use with the DRAGON AO test-bench ([Reeves et al.l 
l2012h . Incidentally, this sensor was also briefly used on-sky 
with CANARY as a substitute laser guide star (LGS) wave- 
front sensor (it has an electronic shuttering capability) after 
a fault developed in the previous sensor. 

Fig. [12] shows slope error (R) as a function of incident 
signal for different sub-aperture spot sizes. As previously, the 
TVM algorithm provides an advantage for slope estimation, 
and gains up to one astronomical magnitude in performance 
for this sensor. 
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4 CONCLUSIONS 

We have investigated the use of a TVM algorithm to improve 
slope estimation accuracy with Shack-Hartmann wavefront 
sensor images. We find that in certain situations with low 
signal-to-noise ratio (with appropriate signal and noise lev¬ 
els), the performance improvements obtained can be equiv¬ 
alent to gaining an astronomical magnitude in photon flux. 
The use of TVM never leads to a reduction in slope esti¬ 
mation accuracy on average. Larger sub-aperture sizes see 
most benefit and so this is particularly relevant for open- 
loop AO systems. Our investigation has shown that TVM 
is applicable for both natural guide star (NGS) and elon¬ 
gated LGS Shack-Hartmann spots. We have also presented 
on-sky results from the GAN ARY AO demonstrator instru¬ 
ment, which provide evidence for successful improvement of 
on-sky AO performance using TVM. 
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